AD-A240  799 


USAFA-TR-91-5 


MULTICRITERIA  EVALUATION  OF  LOT 
SIZING  TECHNIQUES  AS  A  FUNCTION 
OF  DEMAND  PATTERN,  TIME  BETWEEN 
ORDERS,  AND  DEMAND  VARIABILITY 


CAPTAIN  BRYAN  S.  CLINE 
BOBBIE  L.  FOOTE,  AND  ROBERT  E.  SCHLEGEL 


APRIL  1991 

FINAL  REPORT  -  MATHEMATICAL  SCIENCES 


APPROVED  FOR  PUBLIC  RELEASE;  DISTRIBUTION  UNLIMITED 


DEAN  OF  THE  FACULTY 
UNITED  STATES  AIR  FORCE  ACADEMY 
COLORADO  80840 


TfflS  DOCUMENT  IS  BEST 
QUALITY  AVAILABLE.  THE  COPY 
FURNISHED  TO  DUC  CONTAINED 
A  SIGNIFICANT  NUMBER  OF 
PAGES  WHICH  DO  NOT 
REPRODUCE  LEGIBLY. 


REPORT  DOCUMENTATION  PAGE 


form  Approved 
0MB  0704-01  S3 


*0'  :0"eci.cn  Of  -^fcrr'^cion  s  Z9I  •♦'CtCt-O  ire  •  'O^  .-MrjctiOr%.  ^e<';*'r3  -•  >i  n  :  ;j(*  sowf  '-^ 

•}iitre»‘ra  <rc  r^^tri  »»rinq  tne  oji*  n.*^eo  jno  <.orro*e»irq  *no  f (•N.r^-rQ  t*e  ttco  0»  jiion  co"'r*ent%  tn.v  ov»a»''  eMtm  ite  jo,  :irer  o»  ir.s 

cO*i«t'Qr  Ot  .T:'T.»t  O*'  •rcli-’3*n‘5  'o*  TOi-iirf;  ;ris  o<^rcr'‘  t-  A'  nr.r»;i-o  '•»?». ’'it  -»* . f 00''''»i»or>  j'-3  -■•Ch.-mv  ,c‘*e»VN;r 

0*vi1  ni^ew4v  Sw*tc  ’  ?C4  Art'r*<]tor.  va  ;^;02-)0i  *r<3  to  I’'*  0»^'»  »  0»  4*nO  'ii.O  if..  He^uCliOr  P^OlC'.l  tO  ^CJ  J  •  98J.  A-»\nmc('?-»  C'C  <2^0  J 


1.  AGcNCY  USe  ONLY  (Ledve  olanx) 


Z.  REPORT  DATE 

April  1991 


3.  REPORT  TYPE  AND  OATES  COVERED 
Final 


4.  TITLE  AND  SUBTITLE 

MULTICRITERIA  EVALUATION  OF  LOT  SIZING  TECHNIQUES  AS  A 
FUNCTION  OF  DEMAND  PATTERN,  TIME  BETWEEN  ORDERS,  AND 
DEMAND  VARIABILITY 


6.  AUTHOR(S) 

Capt  Bryan  S.  Cline 
Bobbie  L.  Foote 
Robert  E.  Schlegel 


7.  performing  organization  NAIVIE(S)  ANO  ACOR£SS(ES) 

HQ  USAFA  /  DFMS  School  of  Industrial  Engineering 

USAFA  CO  80840  The  University  of  Oklahoma 

Norman,  Oklahoma  73069 


3.  PERFORMING  ORGANISM  iiON 
REPORT  NUMBER 


9.  SPONSORING.  MCNlTCRi.NG  AGENCY  NAM£(S)  AND  AODRESSiES) 
Same  as  #7 


'0.  SPONSORING.  MONITORING 
AGE.NCY  REPORT  NUMBER 


11.  SUPPLE.M-NTARY  NOTES 

Submitted  to  Management  Science  in  April  1991. 


M3.  ASSTRAC'  iMiiiinujrr.  iOp  ^prc: 

The  interactive  effects  of  demand  pattern  (classified  according  to  forecasting 
difficulty),  cost  structure  (represented  by  time  between  orders),  and  demand 
varinbi.lity  on  the  perf ormcnca  of  five,  lot  sizing  techniques  (Eisenhut  Part  Period 
Balance,  EOQ,  Silver-’'eal ,  Tsado,  and  Wagner-Whitin  heuristic)  were  evaluated  using 
empirical  demand  data  from  local  businesses.  Three  performance  criteria  were  used: 
inventory  cost  relative  to  the  Wagner-Whitin  optimal,  number  of  stockouts,  and 
percentage  short  per  stockout.  The  results  indicate  that  selecting  the  best  al¬ 
gorithm  depends  on  the  performance  criterion  selected.  EOQ,  Tsado,  and  Silver-Meal 
performed  best  with  respect  to  relative  inventory  cost,  while  Eisenhut  and  Wagner- 
Whitin  heuristic  performed  best  with  respect  to  the  shortage  criteria.  Percentage 
short  per  stockout  was  affected  by  differences  in  forecasting  difficulty.  The 
effect  was  constant  across  all  techniques.  Significant  differences  among  all 
three  classes  of  demand  variability  were  found  for  all  three  criteria.  Level  of 
forecasting  difficulty  and  variability  do  not  affect  the  optimal  choice  of  lot 
sizing  technique  if  focus  forecasting  is  used. 


USAFA-TR-91-5 


Technical  Review  by  Capt  Greg  Meidt 
Department  of  Management 
USAFA  Academy,  Colorado  80840 

Technical  Rsviaw  LCDR  Christopner  Whitenead 
Department  of  Mathematical  Sciences 
USAF  Academy,  Colorado  80840 

Editorial  Review  by  Lt  Col  Donald  C.  Anderson 
Department  of  English 
USAF  Academy,  Colorado  80840 


This  research  report  entitled  "Multicriteria  Evaluation  of 
Lot  Sizing  Techniques  As  A  Function  of  Demand  Pattern,  Time 
Between  Orders,  and  Demand  Variability"  is  presented  as  a 
competent  treatment  of  the  subject,  worthy  of  publication.  The 
United  States  Air  Force  Academy  vouches  for  the  quality  of  the 
research,  without  necessarily  endorsing  the  opinions  and 
conclusions  of  the  author. 


This  report  has  been  cleared  for  open  publication  and  public 
release  by  the  appropriate  Office  of  Information  in  accordance 
with  AFM  190-1,  AFR  12-30,  and  AFR  80-3.  This  report  may  have 
unlimited  distribution. 


ROBERT  K.  MORROW  JR. 
Director  of  Research 


/' 

,  Lt  Col,  USAF 


Dated 


USAFA  Technical  Report  91-5 
Submitted  April  1991 
Printed  in  U.S.A. 


MULTICRITERIA  EVALUATION  OF  LOT  SIZING  TECHNIQUES 
AS  A  FUNCTION  OF  DEMAND  PATTERN,  TIME  BETWEEN 
ORDERS,  AND  DEMAND  VARIABILITY 

By  Bryan  S.  Cline,  Bobbie  L.  Foote,  and  Robert  E.  Schlegel 

INTRODUCTION 

The  motivation  for  this  research  was  the  observation  of  procurement  syslenib  at  military  logistics 
agencies.  The  inventor^’  ordering  systems  at  these  facilities  are  automated  and  long  years  of  experience 
with  these  systems  are  available.  The  data  result  in  patterns  of  forecasting  error  which  sometimes  favor 
one  logistics  approach  over  another.  Level  demand  sets  in  which  the  mean  is  constant  cause  no  problems 
for  (R,  Q)  models  with  exponential  smoothing  as  the  forecasting  approach.  However,  if  the  demand 
pattern  exhibits  trends  or  has  many  level  changes,  forecasting  is  difficult  and  the  fluctuations  in  R  and  Q 
that  arise  are  very  expensive.  In  the  latter  case,  buying  9  or  12  months  demand  plus  a  buffer  stock  based 
on  a  forecast  at  a  given  time  of  the  year  may  be  much  more  effective  in  terms  of  both  service  level  and 
inventory  cost.  Thus,  a  change  in  logistics  approach  is  dictated  by  tlic  demand  pattern  forecasting 
difficulty  (Foote,  Kebriaei  and  Kuman,  1988). 

The  criteria  used  in  inventory  procurement  is  also  important  in  reducing  the  harmful  effects  of 
demand  variance.  For  example,  if  shortages  are  recognized  explicilely  by  modeling  shortage  costs, 
changes  in  demand  variance  have  a  big  impact  on  order  quantity.  If  shortage  is  modeled  by  service  level 
constraints,  changes  in  variance  have  a  big  impact  on  triggering  an  order.  Different  lot  sizing  techniques 
will  give  different  order  quantities  when  the  same  forecast  is  used.  Liberal  lot  sizing  techniques  that 
"over  order"  will  protect  against  shortages  while  conservative  techniques  will  reduce  or  eliminate  holding 
costs. 

It  is  also  known  that  lot  sizing  tends  to  perform  worse  in  practice  than  in  simulated  tests.  The 
reason  for  this  is  that  actual  demand  patterns  change  over  lime  from  constant  at  a  particular  level,  to 
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trending,  constant  at  a  new  level.  A  change  to  trending  in  the  data  triggers  a  lalsc  estimate  oi  tiie 
variance  when  techniques  such  as  exponential  smoothing  arc  u.scd  Based  on  ob.servations  of  actual 
demand  pattern  changes,  a  study  was  conducted  to  invc.stigatc  die  interaction  of  (1)  lot  sizing  approach. 
(2)  ratio  ot  holding  cost  to  setup  cost  (defining  lime  between  orders  or  "1  BO").  (3)  an  implied  shoiiagc 
cost  model  criterion,  and  (4)  the  demand  pattern  based  on  actual  demands  obtained  from  a  large  national 
distribution  company  and  a  vendor  for  fast  food  chains.  The  selection  of  the  forecasting  techniques,  lot 
sizing  approaches,  and  cost  factors  was  based  on  an  extensive  sur/cy  by  ('line  (1989). 

FORECASTING  TECHNIQUE 

As  discussed  above,  the  accuracy  of  various  forecasting  techniques  in  lenns  of  estimating 
demand  variance,  recognizing  trending,  and  consistently  estimating  die  mean  is  important  in  reducing 
inventory  costs.  Barron  and  Targett  (1985),  Flores  and  Whybark  (1986),  and  Amar  and  (jupta  (FHf-^  all 
point  out  that  forecasting  methods  perform  differently  ca  simulated  data  compared  with  empirical  data. 
Based  on  the  results  of  a  forecasting  competition,  Makridakis  el  al  (1982)  established  die  following 
principles  for  selecting  a  forecasting  technique:  (1)  knowledge  of  the  underlying  demand  pattern  helps 
identify  the  best  technique,  (2)  simple  models  work  well,  and  (3)  the  average  of  die  forecasts  from  simple 
models  is  superior  to  die  forecast  from  a  single  model. 

From  the  literature,  exponential  smoothing  is  more  powerful  compared  with  a  large  number  of 
alternative  approaches  and  is  widely  used  as  a  baseline  technique  (Silver  and  Peterson,  1985).  If  trending 
in  the  data  occurs.  Holt's  exponential  smoothing  model  may  be  used  to  prevent  die  forecasting  technique 
from  becoming  disadvantageous  (Ibid  ).  Based  on  indastrial  short  course  projects  conducted  from  1987 
to  1989,  we  used  die  idea  of  tracking  die  mean  absolute  deviation  (MAD)  and  bias  of  a  set  of 
exponentially  smoothed  forecasts  and  selecting  the  best  forecast  for  the  next  planning  horizon.  Silver  and 
Peterson  (1985)  argue,  however,  that  changing  the  smoothing  constants  (what  diey  refer  to  as  "adaptive" 
smoothing),  while  having  considerable  intuitive  appeal,  is  "not  necessarily  belter  dian  regular,  non- 
adaptive  smoothing."  (e  g.,  Ekem,  1981;  Flowers,  1980;  Gardner  and  Danncnbring,  1980).  Specifically. 
Silver  and  Peterson  feel  the  resulting  forecasts  would  be  excessively  "nervous".  However,  it  is  our 
contention  that  if  a  forecast  model  is  set,  this  effect  does  not  occur.  We  also  believe  the  lot  sizing 
problem  studied  here  only  requires  the  use  of  an  extended  forcca.st  approximately  once  every  "TBO" 
period. 

Since  we  used  automated  forecasting,  the  best  model  for  the  current  data  could  not  be  easily 
determined.  Thus,  only  the  average  of  exponential  models  with  varying  parameters  or  "f(x:us 
forecasting"  which  selects  a  parameter  set  for  Holt's  model  based  on  MAD  and  bias  could  be  used. 

During  program  tests  on  samples  of  empirical  data,  the  focus  forecasting  approach  perfonned 
better  than  averaging  techniques  in  terms  of  less  deviation  and  bias  although  the  difference  was  not 
statistically  significant.  Comparisons  of  the  MAD  for  the  focus  procedure  with  the  MADs  for  each 
individual,  static  procedure  were  quite  favorable.  Focus  forecasting  was  selected  for  tliis  study  since  it 
was  intuitively  more  appealing  and  its  history  in  terms  of  student  forecasting  competitions  reflected  great 
success.  Rather  Uian  use  a  single  model  with  changing  parameters  based  on  error,  we  used  several 
models  with  different  fixed  parameter  sets.  When  a  new,  extended  forecast  was  needed,  tlie  nuxlel  which 
had  the  best  forecast  history  up  to  that  point  was  chosen. 

LOT  SIZING  TFXHNIQUES 

The  following  lot  sizing  techniques  were  compared:  Wagner-Whitm  (W-W),  F.iscnhul  (Part 
Period  Balancing  or  PPB),  Silver-Meal,  LiGQ,  and  Tsado.  The  W-W  approach  (Silver  and  Peterson. 
1985)  has  the  advantage  of  claiming  optimality  over  the  lime  horizon  for  delcnninistic  demand  but 
requires  zero  demand  after  the  last  period  (after  the  time  horizon).  Actual  demand  dtx;s  not  .satisfy  eitJier 
assumption;  however,  Wemmerlov  and  Whybark  (1984)  indicate  the  W-W  approach  is  one  of  tlie  best 
procedures  when  simulated  forecast  errors  are  introduced. 

Eisenhut  part  period  balancing  and  EOQ  do  well  in  many  cases  when  stochastic  demand  is 
introduced  (Callarman  and  Hainrin,  1979).  Silver-Meal  (S-M)  has  performed  well  in  some  studies  witti 
forecast  errors  (De  Bodt  and  Van  Wassenhove,  1981)  and  poorly  in  otliers  (Calhinnan  and  Hainrin, 
1979).  Using  actual  demand  data  with  simulated  error,  the  EOQ,  S-M,  PPB,  and  least  cost  lot  sizing 
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methods  adjusted  to  integral  periods  of  demand  were  indistinguishable  (l)e  llodt  and  Van  Wassenhove, 
1983). 

Tsado  (1985a,  b)  developed  a  heuristic  specifically  to  deal  with  stochastic  demand  and  tested  tlie 
method  on  historical  data.  Tsado  used  the  entire  demand  history  to  produce  die  forecast  and  then 
computed  lot  sizes  based  on  several  approaches.  His  method  appeared  to  work  well  compared  widi  the 
W-W,  EOQ.  PPB,  and  De  Bodt's  modified  Silver-Meal  Unfortunately,  indusu^  tiormaiiy  iia>  only  a 
limited  demand  history.  As  a  result,  Tsado's  methodology  cannot  be  typically  used. 

Wemmerlov  (1989)  analyzed  the  effect  of  data  variance  on  the  perfonnance  of  14  lot  si/ing 
methods  using  simulated  data.  He  found  that,  without  forecast  errors,  W-W  was  best,  followed  by  (iroffs 
rule  and  S-M.  With  errors,  Eisenhut  PPB  was  best,  followed  by  two  of  Wemmcrlov's  rules  1-OQ  :md 
W-W  were  in  the  top  six. 


PERFORMANCE  CRITERIA 


Cost  Structure 

Our  experience  widi  industry  and  U.S.  government  agencies  shows  that  few  companies  or 
logistics  bases  are  comfortable  with  setting  values  on  shortage  or  order  costs  In  die  government,  .service 
levels  are  preferred  as  a  criterion.  The  ratio  per  unit  of  setup  cost  to  holding  cost  is  then  tlie  key  variable 
In  this  study,  these  values  were  ba.scd  on  the  mean  demand  per  period  as  in  Berry  (1972),  Callannan  and 
Hamrin  (1979),  and  Wemmerlov  and  Whybark  (1984).  They  were  established  by  setting  tlie  lime 
between  orders  (the  TBO  in  number  of  periixls  of  demand)  at  2,  4,  6,  8,  and  10.  Using  die  mean  demand 
per  period,  the  a/h  (setup  to  holding)  ratio  which  would  make  each  corresponding  TBO  optimal  was 
determined  and  incorporated  in  each  model.  These  values  also  correspond  to  our  experience  widi 
industrial  concerns. 

Several  measures  may  be  applied  to  evaluate  the  perfonnance  of  lot  sizing  approaches  relative  to 
service  level.  These  measures  include  the  number  of  stockouts  and  die  shortages  as  a  percentage  of 
demand  for  the  short  period.  In  addition,  a  relative  cost  measure  was  obtained  by  comparing  suindtird 
inventory  cost  for  the  algorithm  with  the  cost  determined  by  the  optimal  Wagner- Whitin  algoridim. 

Relative  Cost 

Previous  studies  have  used  the  Wagner-Whilin  heuristic  as  the  baseline  for  cost  comparisons. 
Unfortunately,  the  W-W  procedure  is  suboplimal  in  the  case  of  a  rolling  horizon  and  probabili.stic 
demand.  Arguments  for  the  use  of  the  Wagner-Whitin  heuristic  as  the  baseline  are: 


1.  Wagner-Whitin  is  the  baseline  in  the  deterministic  case. 

2.  It  is  not  known  before  hand  which  rule  will  outperform  the  odiers. 

3.  Use  of  the  Wagner-Whilin  heuristic  provides  an  easy  comparison  to  previous  work. 


We  feel  these  reasons  do  not  justify  the  use  of  a  single  heuristic  as  a  basis  of  comparison.  It  is 
true  that  we  do  not  know  what  the  optimal  inventory  cost  of  a  probabilistic  lot  size  problem  will  be  until 
the  demands  have  already  been  satisfied,  i.c.,  we  do  not  know  what  our  future  demands  will  be 
However,  by  comparing  the  cost  obtained  through  the  use  of  a  heuristic  (when  demand  is  considered 
stochastic)  with  the  optimal  cost  obtained  by  Wagner-Whitin  over  the  entire  demand  "history"  (when 
considered  deterministic),  we  obtain  a  true,  fixed  reference  for  comparision. 

The  key  to  this  fixed  reference  is  in  tlie  interpretation  of  the  cost  comparison.  Specifically,  tlie 
difference  in  cost  between  the  optimal  and  the  huerisiic  may  be  thought  of  as  the  maximum  amount  of 
money  we  would  be  willing  to  pay  for  perfect  knowledge  of  our  future  demand  (referred  to  as  Die 
expected  value  of  perfect  information  or  EVPI).  (See  Raiffa,  1968.) 

Number  of  Stockouts 

Wemmerlov  and  Whybark  (1984),  Tsado  (1985a),  and  others  arbiu-arily  set  service  levels  in 
order  to  handle  the  question  of  stockouts.  By  service  level,  we  mean  tltere  exists  enough  safety  stock  to 
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assure  demands  are  met  a  specified  percentage  of  the  time.  Generally,  levels  between  90  and  99  999 
percent  are  chosen.  As  a  result,  the  stockout  question  is  largely  ignored. 

Since  we  assume  that  stockouts  have  a  ‘’variable"  cost  (i.e.,  the  cost  of  a  stockout  to  one 
organization  may  be  quite  less  than  that  perceived  by  another),  setting  an  arbitrary  service  level  may  not 
be  appropriate.  Further,  by  pre -determining  a  service  level,  the  effects  of  a  lot  size  algoriilim  on 
inventory  (holding  anu  setup)  costs  and  stockout  costs  may  be  confounded  by  tlic  safety  sicx  k  i.ssue 

In  a  manner  similar  to  that  employed  by  Bookbinder  and  H'ng  (1986),  we  chose  to  "count"  die 
number  of  times  a  lot  size  heuristic  produced  a  stockout.  Obviously,  this  number  will  vary  according  to 
TBO  level.  Therefore,  we  chose  to  compute  the  stockout  "cost"  as  tlie  number  of  times  a  stockout 
occurred  expressed  as  a  percentage  of  the  number  of  replenishments  made.  For  example,  given  a  52- 
period  demand  "history"  with  a  TBO  level  of  2,  5  stockouts  out  of  26  replenishments  (approximately) 
would  yield  a  stockout  "cost"  of  0.1923,  i.e.,  about  19.23%  of  the  replenishments  made  would  experience 
a  stockout.  For  a  TBO  of  6  periods,  5  stockouts  would  imply  a  "cost"  of  57  69% 

Percentage  Short  per  Stockout 

Another  factor  in  the  stockout  question  is  the  amount  of  shortage  when  a  stockout  (Kcurs.  I  he 
average  shortage  per  stockout  is  therefore  an  important  "cost"  consideration  However,  an  average 
shortage  of  N  units  does  not  provide  a  significant  amount  of  information.  I'here  are  two  ways  of 
handling  this  problem.  One  is  to  express  the  shortage  as  a  percentage  of  average  denumd.  Anotlier 
approach  is  to  express  the  shortage  as  a  percentage  of  the  actual  demand  for  the  period  in  which  a 
shortage  occurred.  We  cho.se  the  latter.  Justification  for  our  selection  follows. 

Consider  an  average  demand  of  500  units.  If  we  forecast  a  demand  of  550  units  where  die  actual 
demand  is  600  units,  then  our  percentage  short  is  only  8.3%  of  actual  demand.  If  we  had  used  average 
demand,  we  would  have  shown  a  shortage  of  10%.  Now  assume  an  average  demand  of  50  units,  a 
forecasted  demand  of  1(X)  units  .and  an  actual  demand  of  150  units.  We  show  a  shortage  of  33  3'-?  of 
actual  demand  rather  than  a  misleading  l(X)%  of  average  demand.  In  both  cases,  the  forecast  was  50 
units  greater  than  the  average  demand,  and  die  actual  demand  was  50  units  greater  dian  die  Ibrecasted 
demand.  Obviously,  shortage  "cost"  expressed  as  a  percentage  of  actual  demand  is  a  more  accurate 
estimate  of  the  true  "cost"  associated  with  a  shortage. 

PROCEDURE 


Assumptions 

The  assumptions  used  to  develop  the  single-stage,  production  lot  size  problem  ;ire  simihu'  to 
those  employed  by  other  researchers  and  arc  as  follows; 

1.  ITcmand  is  probabilistic  and  is  forecast  using  a  limitc'l  amount  of  prior 
history. 

2.  A  fixed  co.st  is  incurred  for  each  setup. 

3.  The  inventory  holding  cost  is  a  function  of  the  tunount  of  inventory  on  hand  at 
die  end  of  a  given  period. 

4.  Productitm  lead  time  is  zero  (i.c.,  we  have  enough  inventory  at  the  end  of  a 
production  period  to  meet  that  period's  demand). 

5.  All  demands  arc  met  at  the  end  of  each  period  (i  c.,Uic  order  for  die  next 
period  will  cover  shortages  for  die  current  period. 

6.  There  is  no  safety  stock  except  that  which  is  inherent  to  a  piulicular  lot  size 
heuristic. 

7.  Back  orders  arc  allowed. 

8.  There  is  no  monetary  penalty  for  shortages  in  the  cost  calculations  (i  e., 
shortages  are  handled  as  a  separate  criterion. 

9.  Demand  for  the  next  period  is  mn  known  with  certainty. 

10.  An  updated  forecast  is  available  for  any  period. 
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General  Procedure 

Research  on  lot  size  procedures  hxs  been  perfomed  by  Silver  (1978).  Askin  (1981),  HiKikbindcr 
and  H’ng  (1986),  and  Bookbinder  and  Tan  (1988).  Our  procedure  (Figure  1),  while  developed  prior  to 
our  knowledge  of  the  previous  works,  is  similar  to  that  suggested  by  Bookbinder  and  I  an  as  follows: 

1 .  Use  a  focus  forecast  from  simple  exponential  smoothing  and  exponential 
smoothing  with  trend  models  for  demands  over  the  rolling  horizon. 

2.  Treat  the  forecast  demand  as  deterministic  and  employ  a  specific  lot  size 
heuristic. 

3.  If  on-hand  inventory  is  positive,  the  production  quantity  will  be  tlie  amount 
obtained  from  the  lot  size  heuristic  minus  the  on-hand  inventory. 

4.  If  on-hand  inventory  is  negative  (i.e.,  a  stockout  has  iKCurred),  die  production 
quantity  will  be  the  amount  obtained  from  the  lot  size  heuristic  plus  the 
amount  backordered. 

5.  For  each  period,  compare  the  on-hand  inventory  to  the  forecast  for  the  next 
period.  If  the  forecast  exceeds  the  inventory  position,  schedule  a  setup  for 
the  next  period,  otherwise  continue. 

6.  When  the  next  period's  demand  is  realized,  demand  is  met  or  a  shortage 
occurs.  If  short,  schedule  a  setup  for  me  next  period,  otherwise  look  at  die 
next  period's  forecast  (Step  5). 

7.  Develop  an  extended  forecast  only  when  a  setup  is  scheduled 

8.  Condnuc  diis  procedure  until  all  available  demand  data  is  exhausted. 

9.  Discount  the  inventory  holding  cost  for  all  on-hand  inventory  used  to  satisfy 
demand  beyond  the  last  period  in  die  data  set. 


Figure  1.  Flow  Chart  of  General  Procedure 


Although  this  study  used  actual  demand  data  radier  than  a  simulalion,  computer  softwiire  was 
developed  to  generate  the  forecasts,  compute  production  policies  via  the  various  lot  size  heuristics  (and 
the  opUmal  Wagner-Whitin  cost),  and  to  compute  the  criterion  measures  associated  widi  each  technique 
The  forecasting  procedure  and  the  lot  size  procedures  were  programmed  in  MICRO.SOI  T  QuickBA.SIC 
and  run  on  an  IBM  XT  comparable  microcomputer. 
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Forecast  Prm'edure 

I'hc  coniplclc  lorccast  was  ^cncraicd  over  ll>c  enlire  dcniaiul  liislory  nl  each  ilala  ■'Cl  (nn  a 
rolling  horizon  basis)  prior  to  iniplcnicnlation  of  any  lot  si/c  pnKCihirc  1  siiinales  ol  level  ileinaml  .inh 
trends  (when  Hull's  exponential  smootJung  model  was  used)  were  stored  in  ineinuiy  AliJiough  Uie 
forecast  for  each  period  was  used  in  die  lot  size  procedure,  extended  lorecasis  were  -'nly  ileveli'ised  v, lien 
required  by  the  particular  lot  size  heuristic  employed.  To  provide  a  compact  computer  algorillim,  the 
simple  exponential  smcxithing  procedure  was  incorporated  into  Holt’s  procedure  by  setting  the  trciul 
parameter,  g,  equal  to  zero. 

"Focusing",  i.e.,  selecting  the  "best"  forecast  model,  was  carried  out  by  keeping  track  ot  die 
mean  absolute  deviation  and  the  smtxidicd  error  tracking  signal  (bias)  for  each  mdivuliial  or  single 
forecast.  Fslimaies  of  the  MAD  were  also  exponentially  smrxUhed  Hie  forecast  witJi  die  Kst  currcni 
MAD  was  selected  for  die  focused  model  if  the  bias  was  within  accepuibic  limits,  spccificaliy  bciwccn 
0.8  and  0,3. 

Silver  and  Peterson  (1985)  argue  dial  a  negatively  biased  lorccasi  (where  lorec.isi  esi.ecdv  d;e 
demand)  is  preferable  to  a  positively  biased  forecast  (where  demand  exceeds  the  lorccasi)  since  being  a 
few  items  overstocked  is  preferable  to  consistently  being  short  (causing  to  many  premature  setups) 
Wemmcrlov  and  Whybark  (1984)  specifically  avoid  the  use  of  bia.scd  lorecasts  by  adjusting  die  average 
actual  demand  per  perirxl  to  equal  die  average  forecasted  demand  per  penod  While  easily  done  tor 
simulated  demand  data,  this  is  generally  not  appropriate  for  empirical  demand  forecasted  on  a  rolling 
horizon  basis.  Research  by  Lee,  Adam,  and  Fbert  (1987)  shows  that  "bias  is  die  only  measure  dial 
satisfactorily  reflects  inventory  carrying  costs. ..(and)  only  bias  displays  any  reasonable  icssociaiion  witli 
the  shortage  cost  and  shortage  units 

Since  carrying  cost  is  caused  by  over  forecasting  (what  .Silver  and  Peterson  ( IdS.*!)  reterred  to  as 
positive  bias)  ar.d  shortage  costs  are  caused  by  under  forecasting  (negative  bias),  die  use  of  an  unbi.ised 
forecast  (as  used  by  Wemnierlov  and  Whybark,  1984)  might  seem  reasonable.  I'lie  research  by  I  ee  et  al 
(1987),  however,  shows  that  "the  structures  of  diesc  two  component  costs  may  not  be  symmetrica)  about 
the  zero  bias  level."  Unfortunately,  diey  do  not  provide  guidelines  as  to  what  the  nominal  bias  levels 
may  be. 

The  specific  bias  levels  used  in  our  forecast  model  were  delemiiiied  in  conjunction  widi  an 
outlier  discounting  criterion.  Oudiers  were  discounted  by  keeping  track  of  die  average  dcmiuid  and 
standard  deviation  of  die  series  at  each  point  in  the  forecast  "cycle".  If  an  outlier  exceeded  4  standard 
deviations,  the  actual  demand  was  reduced  to  the  mean  plus  4  standard  deviations  for  forecast  purposes 
This  provided  a  stabilizing  influence  on  the  forecast  which  otherwise  would  have  been  provided  by 
human  intervention.  On  the  down,side,  die  .‘‘erecast  mixlel  would  lag  slightly  behind  a  true  sliili  m  die 
mean  of  the  demand  series.  This  type  of  lag.  however,  is  a  standard  "penalty"  for  exponentially 
smoothed  forecast  priKcdures. 


F'l};are  2  Fxample  of  Level  Demand  Pattern 


As  an  example,  die  data  set  in  Figure  2  exhibited  a  steep  downwind  trend  in  die  forecast  model 
due  to  large  upward  spikes  (outliers)  relatively  early  in  die  demand  series  1  he  steep  downward  trend 


6 


LOT  SIZINO  n  x'l  INK^l  !1  i.S 


was  leveled  stmicwhal  by  discounting  the  outliers  and  then  varying  iJic  bias  criteria  in  an  ellori  tu 
eliminate  a  large  series  of  zero  forecasts  caused  by  the  apparant  trend 

KVAI.UA  !  ION  MKIHODOI.OOY 


Demand  Data  Sets 

Of  500  original  sets  of  demand  data  that  were  obtained  from  a  national  product  distribution 
company,  207  were  usable  in  that  no  zeros  or  alphabetic  characters  appeared  as  die  rnonllily  demand 
The  demand  was  based  on  52  weekly  peritxis  and  was  clasifed  by  dilTiculiy  of  forectisimg  tind  by 
variability  as  measured  by  the  coefficient  of  variation  (CV).  Demand  patterns  were  classified  as  easy  to 
forecast  (level  demand,  trending,  or  gradual  change  to  trending)  or  difficult  to  forecast  (abrupt  chaiuu-  or 
continuous  up  and  down  trending). 


Table  I 

Classincatinn  uf  Demand  Data  Sets 


Pat  tern/C  V 

0  <  CV  i  .5 

5  <  CV  <  1 

CV  >  1 

lanear 

12 

6 

5 

Nondinear 

8 

5 

0 

The  categories  for  ('V  were  low  (0  <  CV  ^  .5),  medium  (.5  <  CV  ^  10)  and  high  (CV  >  I  ()) 
These  ranges  have  been  observed  frequently  in  several  organizations,  fable  I  shows  the  cla.ssilicaiioii  of 
demand  patterns  and  the  brctikout  of  ?6  thita  sets  (Group  1)  chosen  randomly  from  the  207  us;ihle  data 
sets  f  igures  2  (previous  page),  3  and  4  are  examples  of  Group  I  data 


1  4  7  10  13  16  19  22  25  28  31  34  37  40  43  46  49  52 

Figure  3.  Example  of  Linear  Trending  Demand  Pattern 
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Figure  4.  F)xample  of  Nonlinear  Demand  Pattern 
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Five  other  demand  data  sets  from  another  company  were  also  used  I  hese  data  sets  ((iroup  2) 
spanned  78  months  but  were  not  classified  as  to  trending  or  variability  All  data  sets  are  available  id 
Cline  (1989), 

Experimental  Design 

For  the  Group  1  data  sets,  a5x5ix2x3  (lot  sizing  technique  x  HU)  x  data  set  type  x 
variability  class)  experimental  design  was  used  with  repeated  measures  on  the  first  two  factors  Lot 
sizing  technique  (Fasenhut,  ECX).  Silver-Meal,  Tsado,  and  W-W  llcunstic)  and  TBO  (2.  4,  6.  8,  and  10) 
were  the  primary  factors  of  interest.  Data  set  type  (easy  vs.  difficult  to  forecast)  and  vanbility  class  (low, 
medium,  and  high)  served  as  stratification  variables.  For  the  Group  2  data  sets,  only  lot  sizing  technique 
and  TBO  were  included  in  the  analysis.  Due  to  the  fewer  number  of  Group  2  data  sets,  stratification  was 
not  feasible. 

Each  demand  data  set  served  as  input  to  each  of  the  five  lot  sizing  techniques  for  each  of  tiic  live 
TBO  levels.  Values  for  the  three  ptrfonnai.vC  measures  (inventory  cost  relative  to  tlie  optimal  W'-VV. 
stockouts  as  a  percentage  of  replenishments,  and  shortage  as  a  percentage  of  actual  demand)  were  thus 
collected  on  900  runs  (36  data  sets  x  5  lot  sizing  techniques  x  5  TBO  levels). 

RESULTS 


Group  1  Data 

The  results  collapsed  across  the  36  Group  1  data  sets  are  sumnuu^ized  in  fable  2  for  the  relative 
inventory  cost,  percentage  of  stockouts,  and  percentage  short. 


Table  2 

Inventory  Costs,  StockouU,  and  Shortages  vs.  Lot  Sizing  Tedmique  and  TBO 


2 

4 

6 

8 

10 

IC  SO  %S 

IC  SO  %s 

IC  SO  %S 

IC  SO  %S 

IC  SO  %s 

IC  so  %s 

Eisenhut 

38,4  11.6  27,6 

29.6  12.7  23.1 

36.9  14  1  17.7 

46  0  15.2  18,3 

74  7  16,4  30.9 

45  1  14.0  23  5 

45.1  8.2  21.6 

29.2  16.7  28.5 

23  6  22.7  26  6 

22.3  26.0  31.6 

18,1  34.2  37.6 

.Silver-Meal 

41.6  11,7  25.7 

25,7  18.4  32.5 

24.5  18.7  23  6 

27.921.3  21.4 

27.0  29,3  31  6 

29  4  19  9  27  11 

Tsado 

39.6  10  9  28  2 

23,1  21  0  29.3 

19.7  26.2  32.4 

18.4  29.9  31.8 

16,3  34,9  42,4 

2.V4  24  6  .32  8 

W-W  Heur 

41,0  9.1  24,0 

32.5  14.4  24,6 

43.3  11.5  20,8 

111.3  5.7  17  3 

323,5  0.5  7.5 

1 10.3  8  3  18',) 

Averages 

41.1  10.3  25,4 

28.0  16.6  27  6 

29.6  18  6  24  2 

45.2  19,5  24.1 

91.9  23.1  30.0 

IC  -  inventory  cost  relative  to  Wagner-Whilin 
SO  -  stockouts  as  a  percentage  of  replenishments 
%S  -  shortage  as  a  percentage  of  actual  demand 


As  illustrated  by  Figures  5,  6  and  7  (next  p.igc),  the  various  lot  sizing  techniques  perfonned 
differently  with  respect  to  standard  inventory  cost  (holding  and  setup)  than  tliey  did  witli  respect  to 
shortage  related  measures.  In  terms  of  inventory  costs  (Figure  5),  the  EOQ,  S-M  and  fsado  algorithms 
performed  significantly  better  than  the  Eisenhut  and  W-W  heuristics,  Altliough  a  Tukey  test  with  an 
alpha  level  of  0.05  demonstrated  statistical  significance,  the  difference  was  of  practical  importance  only 
when  the  TBO  was  large  (8  or  10  periods). 
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■  Eisenhut 
□  EOQ 
♦  S-M 
^  Tsado 
A  W-W  Heur 


Figure  5.  Relative  Inventory  Cost  as  a  Function  of  Lot  Sizing  Technique  and  TBO 


Conversely,  Figures  6  and  7  show  ihe  Eisenhut  and  W-W  hcuri'-iics  resulted  in  significantly 
fewer  shortages  and  a  lower  percentage  of  items  short  per  stockout  than  the  other  three  algorithms.  Tlie 
variability  in  the  number  of  stockouts  (in  terms  of  percentage  of  replenishments)  across  the  different 
levels  of  TBO  was  smallest  for  the  Eisenhut  PPB  technique  with  means  ranging  from  12%  to  18%  The 
W-W  heuristic,  while  slightly  less  stable  than  the  Eisenhut  algorithm,  was  statistically  the  best  overall 
performer  for  number  of  shortages  (with  an  alpha  level  of  0.01).  Variability  in  percent  short  across  the 
TBO's  was  essentially  the  same  for  all  five  algorithms. 


■  Eisenhut 
□  EOQ 
♦  S-M 
Tsado 

A  W-W  Heur 


Figure  6.  %  Stockouts  as  a  Function  of  Lot  Sizing  Technique  and  TBO 


®  Eisenhut 
□  EOQ 
♦  S-M 


Tsado 

A  W-W  Heur 


Figure  7.  %  Short  as  a  Function  of  Lot  Sizing  Technique  and  TBO 


In  all  cases,  the  W-W  heuristic  performed  worst  with  respect  to  inventory  cost  but  best  with 
respect  to  shortages.  At  a  TBO  of  10,  the  W-W  heuristic  provided  solutions  with  virtually  no  stockouts 
and  less  than  10%  of  actual  demand  short  when  a  stockout  did  occur.  The  price  for  this  performance, 
however,  was  an  average  inventory  cost  of  more  than  three  times  the  optimal  solution.  It  appears  that 
both  the  W-W  heuristic  and  Eisenhut  algorithms  maintain  a  significant  amount  of  inherent  safety  stock 
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whereas  the  other  algorithms  tend  to  "run  lean".  Additional  inventory  increases  the  inventory  holding 
costs  but  reduces  the  number  of  stockouts  due  to  bcin^  a  few  items  short. 

Whether  tl>e  demand  pattern  was  easy  or  difneuit  to  forecast  did  not  significaiitly  affect  cillicr 
tlie  inventory  costs  or  the  number  of  shortages  However,  dillieull  demand  data  did  lesult  iii  a 
significanily  smaller  percentage  short  per  stockout  due  to  "over  forecasting"  by  die  linear  roieeast  iiiodel 

The  level  "'f  variability  in  Uic  data  set  (as  indicated  by  die  coelTicient  of  variation)  was  a 
significant  factor  in  that  all  three  variability  classes  differed  significandy  on  all  criterion  measures  (widi 
lower  costs  typically  associated  with  lower  variability  as  would  be  expected).  The  difference  did  not 
hold  for  a  TBO  of  2  where  the  inventory  costs  averaged  41.3,  41.7,  and  39.0  for  the  low,  medium,  and 
high  variability  classes,  respectively.  At  high  variability  for  a  TBO  of  2,  there  tended  to  be  stockouts 
which  lowered  holding  costs. 

Inventory  cost  performance  as  a  function  of  TBO  tended  to  validate  the  "rule  of  diumb" 
advocated  by  Wemmcriov  and  Whybark  (1984)  which  states  that  the  length  of  the  rolling  horizon  should 
be  approximately  three  times  the  average  time  between  orders.  A  TBO  of  4  provided  the  lowest 
inventory  cost  using  a  rolling  horizon  of  12  periods.  However,  performance  as  measured  by  tlie  number 
of  stockouts  and  amounts  short  per  stockout  did  not  support  this  recommendation.  Wcmmerlov  and 
Whybark  also  advocate  a  rolling  horizon  of  at  least  five  times  the  average  lime  between  ordc. .  for  the 
Wagner-Whitin  heuristic  since  it  uses  the  entire  length  of  the  rolling  horizon  to  make  its  initi.'il 
production  decision.  Recall,  in  the  Wcmmerlov  study,  that  service  levels  were  held  constant  for  all 
factors. 

Group  2  Data 

With  only  five  data  sets,  the  simplified  analysis  examined  only  lot  sizing  technique  and  I'UO 
level.  The  results  paralleled  those  for  the  Group  1  data.  Lot  sizing  technique  and  TBO  were  significant 
factors.  The  same  techniques  performed  better  for  the  same  respective  criteria,  however,  witli  fewer  data 
sets,  the  level  of  significance  was  smaller.  Additionaly.  these  data  sets  had  long  periods  of  level  demand 
which  also  tended  to  obscur'^  differences  in  the  techniques. 

Validation 

Since  the  random  sample  was  not  balanced  (i  c.  non-equal  replications  in  all  cells),  additional 
samples  were  drawn  so  that  an  equal  number  of  data  sets  (n  =  5)  occurred  in  each  cell.  Interaction  effects 
could  then  be  more  appropriately  analyzed. 

The  results  not  only  paralleled  the  previous  study,  they  were  much  stronger  and  tlie  conclusions 
they  supported  were  more  clearly  delineated.  The  balanced  design  allowed  an  interaction  analysis  that 
supported  an  interpretation  for  practical  application  as  follows: 

1.  The  level  of  forecasting  difficulty  does  not  affect  the  choice  of  algoritlun  if 
focus  forecasting  is  used. 

2.  The  selected  criterion  does  affect  the  choice  of  algorithm.  Although  not 
statistically  different,  the  order  of  performance  based  on  the  selected  criterion 
is  given  in  Table  3. 

3.  increasing  the  TBO  magnifies  the  difference  between  the  algorithms,  i.c.,  at 
large  TBO  levels  (8  and  10),  the  first  -ranked  algorithm  is  statistically  superior. 


Table  3 

Top  Performing  Algorithms  By  Performance  Criterion 


Criterion 

Best 

Better 

Good 

Cost: 

Tsado 

Lisenhut  PPB 

Silver-Meal 

%  Short: 

W-W  Heuristic 

F.i.senhut  PPB 

%  Stockouts: 

W-W  Heuristic 
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SUMMARY 


Wcmmerlov  (1989)  stales  that  "lot  sizing  research  is  nol  dead”.  Our  results  indicate  Uiis  is  true 
There  is  much  to  be  gained  by  selecting  the  right  lot  sizing  technique  based  on  the  desired  cntcrioii  II 
minimizing  shortages  is  the  criterion  of  choice,  Eisenhut  Part  Period  Balance  or  the  Wagner-Whitin 
heuristic  is  clearly  best.  Otherwise,  EOQ,  Silver-Meal  or  Tsado  are  equally  good  choices.  The  big  gap 
in  research  is  testing  lot  sizing  techniques  using  empirical  demand  data  when  resource  constraints  arc 
present.  Therefore,  further  research  in  this  direction  is  warranted. 
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